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Abstract: This paper focuses on dualizing tail-biting trellises, particularly KV-trellises. 
These trellises are based on characteristic generators, as introduced by Koetter/Vardy (2003), 
and may be regarded as a natural generalization of minimal conventional trellises, even though 
they are not necessarily minimal. Two dualization techniques will be investigated: the local 
dualization, introduced by Forney (2001) for general normal graphs, and a linear algebra 
based dualization tailored to the specific class of tail-biting BCJR-trelhses, introduced by 
Nori/Shankar (2006). It turns out that, in general, the BCJR-dual is a subtrellis of the 
local dual, while for KV-trellises these two coincide. Furthermore, making use of both the 
BCJR-construction and the local dualization, it will be shown that for each complete set of 
characteristic generators of a code there exists a complete set of characteristic generators of 
the dual code such that their resulting KV-trellises are dual to each other if paired suitably. 
This proves a stronger version of a conjecture formulated by Koetter/Vardy. 
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1 Introduction 

It is well known that for a given linear block code, a tail-biting trellis may be smaller than 
the minimal conventional trellis with respect to any of the various notions of complexity of a 
trellis; see the discussion in |101 Sec. III]. Since iterative decoding on tail-biting trellises is well 
understood (as opposed to decoding on more general graphs with cycles), this has led to an 
increased interest in the construction of minimal tail-biting trellises; see also |10| \12\ \15\ [TBI 
[T71 118j. A major breakthrough in this direction has been obtained by Koetter/Vardy [10J. 
They showed that for each A:-dimensional linear block code of length n with full support 
there exists a list of n characteristic generators, each endowed with a span interval, such 
that every minimal tail-biting trellis of the code is structurally isomorphic to a product of 
the elementary trellises of k linearly independent characteristic generators (where structurally 
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isomorphic means trellis isomorphic, but disregarding the edge labels); see |10[ Thm. 5.5] and 
the adjustments in [8l Prop. III. 14, Thm. III. 15]. Here minimality may refer to any of the 
standard complexity notions for tail-biting trellises discussed in |1U[ Thm. 5.6]. Moreover, 
the same results show that for each minimal trellis there is a suitable choice of k linearly 
independent characteristic generators such that the given trellis is isomorphic to the resulting 
product trellis. This shows a major difference from conventional trellises: while the minimal 
conventional trellis of a block code is unique up to trellis isomorphism, this is not the case 
in the tail-biting situation - again, this refers to any minimality notion. Not only may 
there exist minimal trellises with incomparable state complexity profiles or edge complexity 
profiles, but even if both these profiles coincide for two minimal trellises, the trellises may not 
be isomorphic (but they are structurally isomorphic in this situation due to [H Prop. III. 14]). 

We will use the term KV-trellises for product trellises based on k linearly indepen- 
dent characteristic generators in the sense described above. From the construction per- 
formed in [10] , it follows that characteristic generators may be regarded as a generalization 
of MSGM's or trellis-oriented generator matrices in the realm of conventional trellises, see 
[T4"l Def. 6.2] or [Til Sec. IV], or shortest bases in the sense of [5]; see also Lemma 2.6 and 



Remark |2.7| in the next section. As a consequence, KV-trellises, though not minimal in 
general, form a natural generalization of minimal conventional trellises, and indeed, these 
trellises have much nicer properties than more general tail-biting trellises. In the paper [8], 
two trellis constructions based on generators with span intervals have been investigated: the 
product construction and the BCJR-construction, introduced by Nori/Shankar [TS]. It has 
been shown that, in general, a BCJR-trellis is smaller than the corresponding product trel- 
lis. In fact, the latter can be merged to the former by taking suitable quotients of its state 
spaces |8, Thm. IV. 9]. For KV-trellises, however, these two constructions are isomorphic [8, 
Thm. IV. 11]. As a consequence, KV-trellises are non-mergeable. Another demonstration of 
the distinctiveness of KV-trellises will be given in this paper. It will be shown that KV- 
trellises behave significantly nicer under dualization than more general trellises. 

We will investigate two dualization techniques for tail-biting trellises. Both lead to trel- 
lises representing the dual code. The first construction is a specialization of the local dual- 
ization introduced by Forney in [3j for general normal graphs. It amounts to dualizing the 
transition spaces along with a sign inverter; see also [6] for a different approach based on 
graphical models. This dualization has been generalized to factor graphs in |13| and recently 
been recast in the framework of Valiant transforms [TJ . Even though the local dualization is a 
very elegant and convenient construction, for tail-biting trellises it may lead to dual trellises 
with some undesirable properties; see Example 3.2 The second construction is a simple linear 
algebra based dualization for BCJR-trellises as introduced by Nori/Shankar |15| . In Section [3] 
we will see that the BCJR-dual is a subtrellis of the local dual. For KV-trellises, however, 
these duals coincide. Furthermore, as we will show in Section |4j the dual of a KV-trellis is a 
KV-trellis again and thus shares all their nice properties. 

More specifically, in Section [4] we will prove that for each set of n characteristic generators 
of a given code C £ F n , there exists a set of n characteristic generators of the dual code C 1 
such that the dual of each KV-trellis of C based on the chosen generators is (isomorphic to) 
a KV-trellis of C 1 based on the dual generators. We will construct the list of dual generators 
explicitly and also show the direct link between the k linearly independent characteristic gen- 
erators for C and the n-k dual characteristic generators that give rise to the dual KV-trellis. 
In fact, this link is easily described because Koetter/Vardy have shown |1U| Thm. 5.12] that 
the characteristic span list of C 1 is simply obtained by reversing the characteristic spans of C. 
The construction of the dual list of characteristic generators is performed as follows. One 
starts with the BCJR-trellis of C based on the entire list of chosen characteristic genera- 
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tors. This trellis gives rise to n subtrellises obtained by omitting exactly one characteristic 
generator. They still represent the code C. The main result of the procedure tells us that 
the local dual of each such subtrellis contains a cycle that gives rise to a dual characteristic 
generator whose span is the reversal of the span that had been omitted. All of this leads 
to the desired n dual characteristic generators. With the principles of local dualization as 
well as Koetter/Vardy's result of reversed characteristic spans in mind, this approach of con- 
structing dual characteristic generators is quite natural. The details however, carried out in 
Section [4j become rather technical due to certain linear independence conditions that need 
to be verified. 

Let us close the introduction with introducing the basic notions needed for this paper. 
Throughout, a tail-biting trellis T = (V,E) of depth n over the finite field F is a directed 
edge-labeled graph with the property that the vertex set V partitions into n disjoint sets 
V = Vq u V\ u . . . u V n -i such that every edge in T that starts in Vi ends in Vi + i mo( ± n . The 
edges are labeled with field elements from F. Notice that we compute modulo n on the time 
axis I := {0, . . . ,n - 1}. Referring to the fact that a trellis is a state space realization of 
the code regarded as a dynamical system (behavior) on I, we call Vi the state space of the 
trellis at time i, and its elements are the states at that time. The edge set E decomposes 
into E = \J™Jq Ei, where Ei is the set of edges starting in Vi and ending in Vi + \ mo & n . Its 
elements reflect the present-state to next-state transitions, and therefore the edge sets E{ 
will be called transition spaces. We identify the elements of E{ (the edges) with the triples 
consisting of starting state, label, and ending state. Thus, the transition spaces are given by 
E{ = {(v,a,v) | there exists an edge v-^-v where v e V*, v e Vi+i, a f F} c l/ ; x F x Vi+x for 
i e Z. These spaces have also been called trellis sections [3[ [7] or local constraints [I] . 

A cycle in T is a closed path of length n in the trellis. We always assume that the cycles 
start and end (at the same state) in Vq. If \Vq\ = 1, the trellis is called conventional. We call 
the trellis reduced if every state and every edge appear in at least one cycle. The trellis is 
called biproper if any two edges starting at the same vertex or ending at the same vertex are 
labeled distinctly. 

The trellis T is linear if each state space Vi is a vector space over F and the label code 

S(T) = {(vq, . . .,v n -i,c) 6 Vq x ... x V n -i x F n |u - £2 ->wi- £3 -> . . .Vn-t^vo is a cycle in T} (1.1) 

is a subspace of Vo x . . . x V n -\ x ¥ n and if the transition spaces Ei are linear subspaces of 
Vi x F x Vi+i. If the trellis is reduced, then the linearity of Ei follows from the linearity of 
<S(T). We say that T represents the code C £ F™ if C equals its edge-label code, that is, 
C = {(co, • • • , c„_i) 6 F n | there exists a cycle vo-^-vi^ 2 -^ . . vq in T}. 

Note that if T is linear, then the represented block code is linear. We will only deal 
with linear block codes and linear trellis representations. The trellis T is called one-to- 
one if distinct cycles in T have distinct edge-label sequences. The state complexity pro- 
file (SCP) and edge complexity profile (ECP) of a linear trellis T = (V,E) are defined as 
SCP(T) := (so, • • • , s n -i), where Sj = dim Vi, and ECP(T) := (eo, . • • , e n _i), where e$ = dimE'j. 
Throughout this paper, the notion of minimality for tail-biting trellises refers to any of the or- 
derings discussed by Koetter/Vardy in |10| Sec. III]. While for conventional trellises all these 
minimality notions coincide, this is not the case for tail-biting trellises. In [10^ Thm. 5.5, 
Thm. 5.6] and [HI Thm. III. 15] it has been shown that a minimal trellis (with respect to any 



of those orderings) is a KV-trellis in the sense of our Definition 2.4. In this paper we will be 
concerned with KV-trellises, and a specific notion of minimality will not be needed. 

Linear trellises T = (V,E) and T' = (V',E') are called isomorphic if there exists a 
bijection <j> : V — ► V such that <p{Vi) = V- and (f)\y. : Vi — > V( is an isomorphism for all 
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i e Z and (v, a, w) e E{ if and only if (4>(v) a, 4>{w)) e J5£. Obviously, isomorphic trellises 
represent the same code. 

Finally, we fix the following notation pertaining to the code under consideration and its 
representation. Throughout, let 

C = imG = kev H T £ F" be a £;-dimensional code with support I = {0, ...,n — 1}, (1-2) 

where the latter means that for each j e I there exists a codeword (en, . . . , c n _i) e C such that 
Cj ^ 0. Here, imM := {aM\a e F m } and kerM := {a e F m |aM = 0} denote the row space and 
left kernel of the matrix M e F mxn , respectively. We assume G e F rxra , hence rkG = k < r, and 
will explicitly state when r - k and thus G is a full row rank encoder matrix. Throughout, 
H e ]p( n ~ fc ) xn i s a f u n row rank parity check matrix. Furthermore, we fix the notation 



G = (gij) ; -x,...,r = (Gj ... G^i) e F rxn and tf T = 



j=0,...,n-l 



# \ 

; e F nx( "- fc) . (1.3) 

\H n -ij 



Hence G] e F r and ffT e F n ~ fc are the columns of G and il, respectively. Finally, in order 
to avoid extreme cases, we will also assume that C 1 has support I. As for the matrices G 
and H above, we will use the notation Mj for the j-th column of the matrix M and we will 
employ the (Maple) notation row(M, /) for the l-th row of M. 



2 KV-Trellises and the BCJR-Construction 

We will begin by briefly recalling the main results about products of (tail-biting) elementary 
trellises. Thereafter we turn to KV-trellises, the product trellises obtained by choosing k 
linearly independent characteristic generators of the code as introduced by Koetter/Vardy 
in [10]. Finally, we will discuss the BCJR-construction of trellises and recall some results 
from [5] pertaining to the relation between the product- and the BCJR-construction. 

Due to the cyclic structure of the time axis I, the following interval notation has proven 
to be very convenient. For a, b e I we define [a, b] ■- {a, a + 1, . . . , 6} if a < b and [a, b] := 
{a, a + 1, . . . , n - 1, 0, 1, . . . , b} if a > b. Moreover, we set (a, b] ■- [a, b]\{a}. We call the 
intervals (a, b] and [a, b] conventional if a < b and circular otherwise. Notice that (a, a] = 0. 
It is easy to see that X\{a, b] = (6, a] for all a / b. Hence the complement of a nonempty 
conventional interval is circular and vice versa. The following notion from |10| p. 2089] will 
be crucial for this paper. 

Definition 2.1 For a vector c = (co, . . . , c n -\) e F n \{0} we call any half-open interval (a, b] 
a span of c if c a f ^ cj and if the closed interval [a, b] contains the support of c. 

Excluding the starting point a from the span does not seem to be intuitive but will be very 
convenient for our purposes. F] 

Let (a, b] be a span of the nonzero vector c - (cq, . . . , c n _i) e F n . The elementary trellis 
for the pair (c, (a, b]) is defined as T c r a b] ■= (V, E) with the state spaces and transition spaces 
given by Vj = im(^) £ F and Ej = im (fj,j, Cj, fJ-j+i) £ Vj x F x Vj+i, respectively, where fij = 1 
for j e (a, 6] and fXj = otherwise. Thus Vj = F for j e (o, &] and Vj = {0} otherwise. The 

It would be more accurate to distinguish between a time axis for the symbols and a time axis for the 
states, see [5]. Then the span (a, b] of a vector is its active state interval (that is, it is the interval of nonzero 
states of its corresponding cycle in the elementary trellis), while its active symbol interval is given by [a, b]. 
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trellis T Cj ( n i) ] is linear, reduced, biproper, one-to-one, and represents the 1-dimensional code 
in F n generated by c. The trellis is conventional if and only if (a, b] is a conventional span. 
Obviously, the SCP and ECP are given by (sq, . . . , s n -i) and (eo, • • • , e n _i), respectively, 
where Sj = 1 if j e (a, b] and Sj = if j £ (a, b], while ej = 1 if j e [a, 6] and ej = if j £ [a, b]. 

For the following notion of product trellises recall the definition and basic properties of 
trellis products T\ x T2; see, for instance, [10, p. 2089] and [HJ Prop. III.4]). 

Definition 2.2 Let C - imG, where G e F rxn has no zero rows. Denote the rows of G by 
gi, . . . , g r g F n and let S ■- [(a/, 6/], Z = 1, . . . , r] be a span list for G, that is, (cty, fy] is a span 
(conventional or circular) for the row gi, I = 1, . . . , r. The product trellis Tq^s is defined as 
the trellis T g f ai)bl ] x ... x T fl ji. In other words, the state and transition spaces of Tq,s 
are given by Vj = imMj and Ej = im (Mj, Gj , Mj+x), where, as before, Gj denotes the j-th 
column of G and 



e F rxr , where ^ = 



1, ifj6(a/,6/], 
0, ifi^(o,,6,]. 



Let us briefly comment on the subtle differences in the naming of such trellises in the litera- 
ture. First of all, due to Definition |2.1[ we only consider spans such that the vector is nonzero 
at the endpoints of that span (as opposed to general intervals containing the support of the 
vector). This way, we immediately exclude certain (but not all) mergeable trellises; see also 
|10l Lemma 4.3]. This makes our definition more restrictive than the one in [10] . Second, 
in the paper [15], product trellises of the type above (and where G has full row rank) are 
called KV-trellises, and the matrix G, along with its span list, is called a KV-product matrix. 
In the present paper, we will reserve the name KV-trellises for a particular type of product 



trellis that has been introduced by Koetter/Vardy [TU]; see Definition 2.4 

The following properties of product trellises are easy to see. Later on we will only deal 
with product trellises where the starting points (resp., ending points) of the spans are distinct, 
and therefore we restrict ourselves to this case in (d) below. One could easily give the formulas 
for the more general case. 

Proposition 2.3 Let the data be as in the previous definition and put T ■- Tqs- Then 

(a) T is a linear and reduced trellis. 

(b) T is one-to-one if and only if rk G - r. 

(c) T is biproper if and only if ai, . . . , a r are distinct and bi,...,b r are distinct. 

(d) Let ai, . . . , a r be distinct and b\, . . . , b r be distinct. Then the SCP and ECP ofT are given 
by (s ,...,s„-i) and (e , . . . , e„_i), respectively, where Sj = \{l = 1, . . . ,r \ j 6 (ai,bi]}\ 
and 

Sj + l, ifje{a 1 ,...,a r }\_js j+ i + l, if j e {61, b r } 



'j> if j {{ai,...,a r } J I s j+ x, if j j. {61, . . . ,b r }. 

Proof: (a), (b) as well as the formulas in (d) follow easily from the properties of 
elementary trellises as well as those of trellis products; see also Prop. III. 4]. 
(c) The implication "=> " follows from the proof of [10\ Cor. 4.5]. The converse has been 
shown in |8l Thm. III. 6]. □ 

We now turn to a particular class of product trellises, introduced by Koetter/Vardy |10j . 
A main result of [TU] - and a major breakthrough in the study of minimal tail-biting trellises 
- is the construction of a list of characteristic generators, collected in a characteristic matrix, 
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from which all minimal trellises can be derived. In [10], this matrix is defined as the outcome 
of a particular procedure. We will follow the presentation in [8] and define the characteristic 
matrix in terms of its relevant properties. A justification of this approach versus the one 
in [10] has been given in [8] Sec. Ill] 



Definition 2.4 Let C £ F n be as in (1.2). A characteristic pair of C is defined to be a pair 
(X, T), where 



X 



6F" X ™ andT=[(a,,6 l ],Z = l,...,n] (2.1) 



\Xnl 



have the following properties. 

(i) imX - C, that is, {x%, . . . ,x n } forms a generating set of C. 

(ii) (a/, b{\ is a span of X\ for I = 1, . . . , n. 

(iii) ai, . . . , a n are distinct and bi,...,b n are distinct. 

(iv) For all j e Z, there exist exactly n - k row indices, l±, . . . , l n -k, such that j e (a^, 6/J for 
i = 1, . . . , n - k. 

We call X a characteristic matrix of C and T the characteristic span list. The rows of X are 
also called characteristic generators. A trellis Tq,s is called a KV^x,T)'^ rems of C if G e F fcxn 
consists of k distinct linearly independent rows of X and S consists of the corresponding k 
spans in T . A trellis is called a KV-trellis of C if it is a KV(jjf 7-) -trellis for some characteristic 
pair (X,T) of C. 

The relevance of characteristic pairs and KV-trellises becomes apparent in part (b) below: 
the class of KV-trellises contains all minimal trellises. As a consequence, one may restrict the 
study of tail-biting trellises to the important class of KV-trellises. For the following results 
it is crucial that C has support I. 

Theorem 2.5 ([10, Sec. V], [5J Thm. III. 15]) (a) The code C has a characteristic pair, 
and the characteristic span list is, up to ordering, uniquely determined by C. 

(b) For every minimal trellis T of C there exists a characteristic pair (X, T) such that T is 
a KV( X ,T)~t rems - 

The following property shows that characteristic spans are "shortest spans" for each given 
starting point. This property not only makes it algorithmically easy to find characteristic 
generators for a given code, see Remark |2.7| below, but will also be crucial later on in order 
to derive strong properties for KV-trellises. 

Lemma 2.6 Let c e C be a nonzero codeword with (conventional or circular) span (a, b]. 
Then (a, b] £ (a, b], where (a, 6] is the unique characteristic span starting at a. 



Proof: Notice that by Def. 2.4 iii), there does indeed exist a characteristic span (a, 6] 
starting at o. Let us first consider the case where a = 0. By (iv) of the same definition there 
exist exactly k characteris tic s pans not containing 0, thus k conventional spans. One of these 



spans is (0,6]. Definition 2.4 'iii) tells us that generators with these spans form an MSGM 
of C in the sense of [14:\ Def. 6.2, Thm. 6.11]. As a consequence, it has minimal span length. 
This implies that (0,6] £ (0,6], for otherwise we could replace the generator with span (0,6] 
by c and obtain a generator matrix with shorter span length. 



If a ^ 0, we may use the cyclic left shift cr a by a units in F n . From Definition 2.4 



we 



obtain immediately that if T = [(ai, &i], • • • , (a n , b n ]] is the characteristic span list of C with 
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generators xi,...,x n , then [(ai - a, b\ - a], . . . , (a n - a, b n - a]] is the characteristic span list 



of the code <7 a (C) with generators a a (xi), . . . , a a (x n ); see also Remark 2.11 further down. 
Since cr a (c) e c a (C) has span (0, 6 - a], we may now make use of the first case. This leads to 
the desired result. □ 

Remark 2.7 The above result allows us to set up a greedy algorithm for finding the charac- 
teristic spans of a given code (with support I). Namely, for a = 0, . . . , n- 1, let b a e I be such 
that (a, b a ] is the shortest span among all possible spans starting at time a of the (nonzero) 
codewords in C. Then the resulting list [(a, b a ], a = 0, ...,n- 1] is the characteristic span 
list of C. The same can be done by screening the spans by their ending points. Of course, 
the greedy algorithm will also produce, at the same time, a list of characteristic generators, 
that is, a characteristic matrix. This generalizes the "shortest basis approach" described by 
Forney in [3] for very general (conventional) realizations to the tail-biting case. 

The following construction of tail-biting trellises has been introduced by Nori/Shankar 
in [151 Sec. Ill] and studied in detail in [HJ Sec. IV]. We will generalize this slightly by also 
allowing generator matrices that do not have full rank. For (b) recall that row(D,l) denotes 
the l-th row of the matrix D. 



Definition 2.8 Let the code C and the matrices G e F rxn , H e F^)*™ be as in ([O]) 
and ( f!~3l ). 

(a) Let D e F rx ("~ fc ) be any matrix. For i e X define the matrices 

N = D and JV< = iV l _ 1 + Gj_ 1 H ir . 1 for i > 0. (2.2) 

Then N n = N . We define T^ G H D ^ to be the trellis with state spaces Vi := imiVj £ W n ~ k 
and transition spaces E{ = im (iVj, Gj, iVj+i). It is easy to see that TrG,H,D) i s a linear, 
reduced, and biproper trellis representing the code C. We call D the displacement matrix 
for the trellis T(g,h,d) ■ 

(b) Let S ■- [(ai,bi],l = 1, . . . , r] be a span list of G. Then the trellis T^ G HS ^ is defined as 
T (G,H,D), where 

n-l 

D e F rx(n_fe) is such that row(L>, = E 9U H i for 3 = ^ ■ • • ' r - ( 2 ' 3 ) 

j=ai 

The trellis T(g,h,s) ^ s called a (tail-biting) BCJR-trellis of C. 

Notice that if D - 0, then the trellis TfQ jj jy\ is conventional. If in addition, r = k = rkG, 
then T(Q H£)j is, in fact, the classical conventional BCJR-trellis of C, hence minimal, see |144 
Sec. IV] and [2]. In general, the rows of the displacement matrix D may be interpreted as 
the (circular) past of the generators in G. As always in state space realizations, this past 
is captured in the state at time through which the associated trajectory (cycle) passes. 
Consequently, the l-th. rows of the matrices Nj form the sequence of states through which 
the cycle induced by the l-th generator passes. In this sense, the BCJR-trellis is, just like the 
product trellis, based on r individual generators with spans. The state spaces arise as the 
sum of the state spaces of each generator (while for product trellises they are the direct sum 
of the state spaces). As a consequence, BCJR-trellises are not always one-to-one, even if the 
generator matrix G has full row rank. 

The following results have been proven in [S] for the case where G e F fcxn has rank k. One 
can easily verify that the same proofs apply to G e F rxn with r > k = rkG. For the notion of 
mergeability, we refer to [TO], Sec. II. B] or JSJ Sec. II]. 
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Theorem 2.9 ([8, Cor. IV. 7, Thm. IV.9, Rem. IV.13, Thm. IV.ll]) Let G, H, and 



the span list S be as in Definition 2.8 



(a) The BCJR-trellis T^ G HS ^ is non-mergeable. 

(b) If the product trellis Tq.s is non-mergeable, then T^s IS isomorphic to TiQ jj gy 

(c) If the product trellis Tq,s has the same SCP as the BCJR-trellis T(g.h,s)> then these two 
trellises are isomorphic. In this case, the starting points of the spans in S are distinct 
and so are the ending points. 

It is worth noting that every product trellis Tg,s can De merged to the corresponding BCJR- 
trellis T (G:H;S) , see Thm. IV.9]. 

Example 2.10 (a) This example appeared already in [U Ex. IV. 12]. It will be revisited later 
again when discussing dualization techniques. Consider the code C = im G = kerF T c F 5 



2< 



where 



G 



/0 
1 



0\ 





H 



fl 1 1 l\ 
^01100/ 



\0 1 1 1/ 

Then S := [(1,3], (3,0], (2,1]] is a span list for G. Making use of the greedy algorithm 



in Remark 2.7 and checking all 8 codewords, it is easy to see that (1,3] and (2,1] are 
characteristic spans of C, whereas the codeword (1,0,0,0,1) e C with span (4,0] shows 
that (3,0] is not a characteristic span. The BCJR-trellis T := T/g,H,S) ^ as state an d 
transition spaces given by Vj 
the matrix 



im Nj and Ej 



mi (Nj,G],N j+1 ), where Nj are given m 
(No\G^\N 1 \Gj\N 2 \Gj\N3\Gj\N i \Gl\No) = 

(2-4) 



/o 














1 





1 


1 


1 





1 














0\ 


1 





1 


























1 


1 








1 





lo 


1 








1 


1 








1 


1 


1 





1 


1 


1 








In this matrix we stagger Nj with the columns of G in order to easily read off the 
transition spaces Ej. The trellis T is shown in the figure below (here and in all other 
trellises we will denote edges with label one as solid lines and those with zero label as 
dashed lines). It is straightforward to see that the corresponding product trellis Tq,s bas 
the same SCP as T and therefore is isomorphic to T according to Theorem 2.9 As a 
consequence, T is one-to-one, which we can see also directly from the trellis. Notice that 
by the above, T is not a KV-trellis. 




[Trellis 21 



(b) Consider the self-dual code C £ with C = imG = kerG T , where 

( l 1 1 l \ 
\0 1 1 0/ 



G 
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A characteristic pair is given by 



(c) 



X 



(1 

1 
1 

M i 



i\ 

1 
1 

1 1/ 



, T= [(3,0], (2,1], (1,2], (0,3]]. 



(2.5) 



This can easily be seen by applying Remark 2.7 to the three nonzero codewords in C 



Let us consider the BCJR-trellis Trx,G,T)- The matrix 



I 1 





1 


























1 


1 


0\ 


1 


1 





1 


1 


1 








1 


1 


1 





1 


1 

















1 


1 


1 


1 

















\0 





1 


1 





1 





1 


1 


1 





1 





0/ 



5 = (NolX^N^XjlN^XjlNslXjlNo) = 



lists the state space matrices Nj staggered with the columns of X. We will not display 
this trellis as it is not a very useful trellis by itself. For instance, it is not one-to-one. 
However, we can easily read off the state space matrices and transition spaces for all 
KV(jf f) -trellises by simply taking the submatrix of S consisting of any two rows for 
which the corresponding two rows in X are linearly independent. This results in five 
KV(jfj) -trellises. It is an immediate consequence of Proposition 2.3 ^d), that no two 



of these trellises have the same SCP and ECP. In particular, they are pairwise non- 
isomorphic. The trellises Trx,G,T)> based on an entire characteristic matrix, will be used 
in Section [4] as the starting point of the duahzation procedure. 



Let C = imG = kevH T c F|, where 



12 
11 



H = 



110 
12 



The pair (X, 7~), where 



X = 



/l 2 0\ 

2 10 

11 

\1 2 1 1/ 



, T= [(0,1], (1,0], (2,3], (3,2]], 



is a characteristic pair of C. The matrix X is normalized, that is, each characteristic 
generator has coordinate 1 at the starting point of its span. It can easily be seen that C 
has 9 different normalized characteristic matrices with span list T. 

The product construction as well as the BCJR-construction behave nicely under the 
cyclic shift. This is described in the following remark, of which we will make frequent use. 
Recall that we compute with indices modulo n, which, of course, also applies to the span 
lists. 



Remark 2.11 Denote the rows of G by gi,...,g r e F n and let the span list S be as in 
Definition |2.8[b). Let a denote the cyclic left shift on F n and let G* e F rxn be the matrix 
consisting of the shifted rows o{gi), I - 1, ... ,r. Then S* = [(a/ - 1, b% — 1], I = 1, . . . , r] forms 
a span list for G* . The state and transition spaces of the product trellis T g*.s* are given by 
V* = imM !+ i and E* = im (Mj+i, Gj +1 , Mi + 2), where Mi is as in Definition 2.2 Similarly, if 
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(X,T) as in (2.1 ) is a characteristic pair for C, then (X*,T*) is a characteristic pair of <r(C), 
where 

(a(xi)\ 

X*=\ ; , T:=[(a,- 1,6,-1], J = l,...,n]. 
\<r(xn)/ 



Finally, if D is as in (2.3) and iVj are the state space matrices of T(g,h,s) as m (2-2), then 
the state space matrices for the BCJR-trellis T^g*,h*,s*) are given by N* = N+i for i el. 

In this paper, we will mainly consider BCJR-trellises based on characteristic generators. 
The following theorem will be crucial later. 

Theorem 2.12 Let (X,T) be a characteristic pair of C. Let G e F rxn be a selection of r 
rows of X and S := [(ai,bi],l = 1, . . . ,r] be the corresponding selection of characteristic spans. 
Thus, (a,, b{\ is the span of the l-th row of G. Consider the BCJR-trellis T(g,h,s)> an d let 
Nj e Y rx ( n - k ) } j el, be its state space matrices. Then for every j el 

(1 ) row(iVj, I) = for all I such that j £ (a/, 6,], 

(2) the set { row(Aj, Z) | I such that j e (a,, bi]} is linearly independent. 

As a consequence, T(q,h,s) is isomorphic to the corresponding product trellis Tq^s- Therefore 
it makes sense to call TrQ,H,S) a KV-trellis in the case where r = k = rkG. 

Proof: The statement in (1) has been proven in [HI Prop. IV. 6] for BCJR-trellises T(g,h,S)i 
where G e F fcxn has rank k. It can easily be seen that the same proof applies to the general 
case for G. As for the second statement, first consider j = 0. Then j e (a;,fy] is equivalent 
to (ai, bi] being a circular span. In the proof of [8, Thm. IV. 11] it has been shown that 
the set {row(iVo,0 | (cfy,6z] circular} is linearly independent (these rows appear in the ma- 
trix Z e ]p(«- fe ) x (n- fc ) i n jgj Eq. (IV. 5)], which is non-singular due to the same proof in [8]). 
This proves (2) for j = 0. Applying a cyclic left shift by j steps (see Remark 2.11), we obtain 
the desired result for arbitrary Nj, and this completes the proof of (2). 
Finally, the previous results tell us that rkiVj = \{l \ j e (a,,6,]}|. Furthermore, due to Defini- 
tion [2T4J the starting points of distinct characteristic spans are distinct, and the same is true 
for the ending points. Therefore we may apply Proposition 



2.3 



d) and conclude tha t T(g ,h,s) 



and Tq s have the same SCP. Thus, these trellises are isomorphic due to Theorem 2.9 



c . □ 



We close this section with the following technical results pertaining to the BCJR-presenta- 
tion of KV-trellises, which will be needed later on. 

Lemma 2.13 Let T = T,g,h,S) De a KV-trellis of C, that is, G = (gij) e ¥ kxn has rank k and 
its span list S = [(o,, 6,] | I = 1, . . . , k] consists of characteristic spans of C. Let Nj, j e I, be 
the state space matrices of T. Then 

(i) If j = b\ for some I, then Hj = -g^ 1 row(Nj,l) 

(ii) If j i {61, . . . , b k }, then Hj i imNj. 

As the proof will show, part (i) is true for general BCJR-trellises, and only (ii) needs the 
particular properties of characteristic spans. 



Proof: Using a cyclic shift, see Remark 2.11 , we may assume without loss of generality 
that j = 0. 

where the last identity 



(i) Let = 6,. Then ((pj) implies row(JV ,0 = E£j = -9iqH , 



follows from the identity GH T = along with the fact that (a;, 6;] = (a;, 0] is the span of the 
Z-th row (gio, . . . ,gi, n -i) of G. This establishes (i). 

(ii) Let ji {b\, . . . ,bk] and assume Hq = (3Nq for some (5 e ¥ k . Using the definition of Aq 
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in ( |2.3[ ), this becomes Hq = T,i=i/3iT l %a l 9ljHj. Notice that Hq 0, due to our general 



assumption that the dual code C 1 has support X. Therefore with the aid of Theorem 2.12[ l 



the above may be written as Hq = Y,ucfti £j=ai 9ijHj, where C ■- {I | e (a;, b{], £ 0} and 
C ^ 0. Let s e C be such that a s = min{a^ | f" e £}. Then a s > because the condition 
e (a/,6j] implies that the span is circular. Define the vectors 



m = (g, 



10} 



><?Z,n-l)> where <?y 



0, iij<a h 



Then we obtain Hq = Y,uc PitliH 1 . As a consequence, c := T,ucfii9i ~ e o e kerff T = C, where 
eo e F n is the first standard basis vector. Now the definition of g\ shows that the codeword c 
has span (a s ,0], and thus Lemma 2.6 implies (a s ,b s ] £ (a s ,0]. Since (a s ,b s ] is circular, this 
in turn yields b s = 0, contradicting our assumption that ^ . . . , bj~}. This proves (ii). □ 



Theorem 2.14 Let T^ G H S ^ and Nj be as in Lemma 



2.13 



Then n"r limAr i 



{0}. 



Proof: Let w e n" =c \imNj, say u; 



a_jiVj for some aj = (aj,i, . • . , 6 F fc , j e X. We will 
first show that there exists some common a e ¥ k such that w = aNj for all j 6 X. 
Note that = atj+iNj+i - ctjNj = aj+i(Nj + Gj Hj) - ctjNj, hence ctj+iGj Hj = (ay - a>j+i)Nj. 
Observe that aj+iGj e F, thus a scalar. 

i) If atj+iGj = 0, then aj - ay+i e ker iVj, and Theorem 
that j e (a i} 6i]. 

ii) If aj+iGj" ^ 0, then the above yields Hj = (aj+iGj)^ 1 (aj - aj+i)Nj. In this case 



2.12 



implies au; = ocj+n for all I such 



Lemma 2.13| implies that j = b m for some m e {1 



Lemma along with Theorem 
But then i) and ii) together yield 



,k}. Furthermore, part (i) of that 
2.12 '1) and (2) shows that a^y = ay+i i for all I ^ m such that 



OLjl = atb h i for all I such that j e (a/, 6/]. 



(2.6) 



2.12 



T) once more, along with (2.6) 



Define now a ■- (a^i, . . . , a.b k ,k) e F fc . Using Theorem 
it is straightforward to see that aNj = ctjNj = w for all j e I. 

Now we have = w - w = a(Nj+i - Nj) = aGj Hj for all j e X. Since Hj f for all j e X, this 
leads to otGj = for all j e X and hence aG = 0. As a consequence, the full row rank of G 
implies a = 0, and we arrived at iu = 0, as desired. □ 
It is worth noting that the last result is not true for general BCJR-trellises T^ G H ^^, 
even if G e W kxn has rank k and the trellis is isomorphic to the corresponding product trellis. 
An example is given in Example 2.10[ a). The trellis T displayed in that graph satisfies 
T (G,H,s) = T G,S and G e F| x5 has rank 3, but (0, 1) e f^ =Q imNj, where Nj are as in pi] ). 



3 Dualizing Trellises 

In this section we will investigate two methods of dualizing a given trellis in order to obtain 
a trellis representing the dual code. One method is what we call local dualization, and it 
amounts to taking duals of the transition spaces along with a sign inverter. This very elegant 
and profound method has been introduced by Forney in [3] and applies to all linear (even 
group) realizations; see also the presentation based on graphical models in [B]. Theorem |3.1| 
below is simply a special case of it. The second method comes naturally with the BCJR- 
construction and has been introduced by Nori/Shankar in [15] . We will show that, in general, 
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the BCJR-dual is a proper subtrellis of the local dual and that for KV-trellises the two 
coincide. There is yet another notion of trellis duality, introduced by Koetter/Vardy in \10\ 
Ch. VII], based on what they call the intersection product. As it turns out via straightforward 
computation, this notion is identical to the local dual. 

We begin with the local dualization, which in our particular case of tail-biting trellises 
looks as follows. 

Theorem 3.1 Let T = (V, E) be a linear trellis representing the code C £ F". Let Vj, j e X, 
be vector spaces such that dim Vj = dim Vj for all j e X, and fix non-degenerate bilinear forms 
(• , • ) on Vj xVj, j zl. For each transition space Ej £ Vj x F x Vj+\, define {Ej)° as the dual 
space with respect to the bilinear form 

{Vj x F x Vj+i) x (VjxF x Vj+i) — ► F, ((v,a, w), (i),b,w)) \ — ► (v,v) + ab- (w,w), 

that is, 

(Ej)°:={(v,b,w) e Vj xFx V j+ i\{v,v) + ab - (w,w) = for ail (v, a, w) e Ej}. (3.1) 

Then the trellis T° = (V,E°), where V = U£o V i and E ° = ^7=o( E 3)°> ™ linear and repre- 
sents C 1 . Furthermore, SCP(T°) = SCP(T) := (s Q , . . . , s n _ x ) and 

dim(Ej)° = Sj + Sj+i + 1 - dimEj for j e I. (3.2) 

We call T° the local dual ofT. 

One should notice that, via the non-degenerate bilinear form, the space Vj is isomorphic to 
the linear algebra dual of Vj consisting of all linear functionals on Vj. Conversely, the linear 
algebra dual naturally gives rise to a non-degenerate bilinear form and therefore may serve 
as dual state space Vj. Later on we will make specific choices for Vj and the bilinear form, 
justifying our setting in Theorem |3.1| 

It should be noted that the isomorphism class of the trellis T° does not depend on the 
choice of the spaces Vi and the non-degenerate bilinear forms. Indeed, if ( • , • ) 1 and ( ■ , ■ ) 2 
are two such forms on Vj x Vj and VjxVj, then there exists an isomorphism <f)j : Vj -> Vj such 
that (v , w) 1 = (v, 4>j(w)) 2 for all v 6 Vj, w 6 Vj. As a consequence, this isomorphism furnishes 
a trellis isomorphism between the two corresponding dual trellises. 

The theorem is a special case of the local dualization procedure for normal graphs derived 
in [U Sec. VII]. However, we think it is worth reproducing Forney's proof for this special case. 



Proof: It is clear that the label code S(T°), see (1.1), as well as the transition spaces 



(Ej)° are linear spaces. Hence T° is a linear trellis. Moreover, the bilinear form on (Vj x F x 
Vj+i) x (Vj xFx Vj+x) is non-degenerate, and therefore dim(£j)° = dim(Vj x F x Vj+i) -dimEj, 



proving (3.2) 



It remains to show that T° represents C . In order to do so, define 

V := Vq x V\ x V\ x Vi x Vi x . . . x V n -\ x V n -\ x Vq, 

V := Vo x V\ x V\ x Vi x Vi x . . . x V n -i x V n -x x Vo, 

(that is, we are replicating each state space). The given bilinear forms on each Vj x Vj 
naturally give rise to a non-degenerate bilinear form ( • , • ) on V x V via 

n— 1 n-l 

((v Q ,vi,vi,. . . ,v n -i,v n - 1 ,v ), (w ,wi,wi,. . . ,w n -i,w n -i,w )) = + Y,( v j> w j)- 

3=0 3=0 
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This further extends to a non-degenerate bilinear form 



(V x F n ) x (V x F") — >■ F, ((v,a), (w,b)} = (v,w) + ab T . (3.3) 

Recall that the transition spaces Ej are contained in Vj x F x Vj+±. Hence, the direct product 
Eq x . . . x E n -i is in V x F ra , if we sort the state and edge labels accordingly. Denoting this 
obvious permutation by p, we therefore have 

V := p(E x Ei x ... x £ n _i) c V x F". 

Now we use the replication space 

TZ := {(v ,vi,vi,v 2 ,v 2 ,.. . ,v n -i,v n -i,v Q ) | Vj e Vj} c V 

in order to relate edges in the various transition spaces Ej with each other by checking 
whether ending and starting points coincide. Indeed, the label code S{T) defined in fll.ip is 
given by the conditioned space 

(V\TZ) ■■={(v,a)£V\veK} 

(to be precise, we also have to eliminate for v e TZ one copy of each state to obtain S(T)). 
As a consequence, the code C is the projection 

C = it(V I TZ) = {a e F n | 3 v e V : (t>, a) e {V \ K)}, 

where n denotes the natural projection of V x F n onto F n (this is the identity C - {V \ TZ)\i A 
in [U p. 540]). Now we may take duals with respect to (•,•)• Then Forney's Theorem 
on Conditioned Code Duality [H Thm. 7.2] (or straightforward verification) tells us that 
C L = \_tt(V I 7£)] = 7r('P 1 I 7Z L ). Here • 1 refers to the bilinear form in (3.3) or a restriction 
of it to the appropriate subspaces. It remains to clarify the relation between the latter space 
and the trellis T° . From the very definition of V and TZ and the bilinear forms involved we 
obtain 

^=p(i#x...x 

TZ 1 = {(w , -wi, u>i, -w 2 , w 2 ,.. .,-w n -i,w n -i,-w ) I Wj e Vj}, 

where Ej = {(w, b,w) e Vj x F x Vj+\ \ (v, w) + ab+ (v, w) = for all (v, a, v) e Ej}. Observing 
that (wj, bj, -Wj+i) 6 Ej (wj,bj,Wj+i) e (Ej)°, we see that 

'k{V l I = {6 e F n | there exists a cycle in T° with edge-label sequence b}. 

This proves that T° represents C 1 , as desired. □ 
The following two examples illustrate that in specific cases local dualization may lead to 
undesirable trellises. While in the first example this is not surprising because the primary 
trellis is not even proper, the second example is more unexpected. It shows a BCJR-trellis that 
is isomorphic to the corresponding product trellis and thus non-mergeable (hence biproper) 
and one-to-one, and yet the local dual is not reduced. In Theorem 3.5 below we will see that 
this does not happen for KV-trellises. It will be shown that the local dual of a KV-trellis is 
isomorphic to the BCJR-dual and thus reduced. Furthermore, in Section [4] we will show that 
this dual is even a KV-trellis of the dual code. 
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Example 3.2 (1) Consider the 2- dimensional code 



and choose the span list S = [(1, 2], (0, 2]]. Then the corresponding product trellis T = 
T GjS has SCP (0, 1,2) and ECP (1, 2, 2) and is shown in the figure below. Notice that T 
is a conventional trellis, but not proper (and thus not minimal). The transition spaces Ej 
of T can be read off from the matrix 



(M | G~l | Mi | Gj I M 2 | Gj I M ) = 



/ 








1 


1 


1 


\ 


x 


1 


1 





1 


1 


0/ 



see Definition 2.2 for the state space matrices M,- of product trellises. According to 



Theorem 3.1 the local dual T° has SCP (0,1,2) and ECP (1,2,1). In order to com- 



pute T° , we observe that the standard bilinear form on F| induces a non-degenerate form 
on each Vj = imM,-, and thus may be used for the computation of the dual transition 



spaces (Ej) c 
compute 



In particular, we will use Vj for the dual state spaces as well. Then we 



(£ )°=im(0 | 1 | 1), (£i)°=im^ J J J jV (£ 2 )° = im( 1 l|l|0 0). 



This leads to the following trellis T° 





[Trellis T] [Trellis T°] 

Obviously, not every vertex appears in a cycle and thus the trellis T° is not reduced. As 
a consequence, T° is not a product trellis in the sense of Definition 2.2 
(2) Consider Example 



2.10 



a,). The BCJR-trellis T ■- TrQ jj,S) given in that example has 
state and transition spaces Vj = imNj and Ej = im(Nj,Gj ,Nj+i), with all matrices 
displayed in the matrix (2.4). In order to compute the local dual T°, we may again use 
the standard bilinear form on F| and thus let Vj be the dual state space as well. Then 



1 



(£o)° = im, () j 
(Ei)° = im( 1 | 1 | 1 ) 



(E 2 )° = im 




1 




1 



1 

1 1 










1 


1 




= im 


(o 


1 








!) 




/ 1 








1 


i \ 


= im 





1 








i 




lo 


1 


1 





0/ 



This leads to the first trellis in the following figure. 
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[Trellis T°] [Trellis T 1 ] 

The trellis T° is not reduced because not every edge appears in a cycle. Indeed, the four 
diagonals in (L4) , the last section of the trellis, are not part of any cycle in T°. If we 
remove these 4 edges, then we obtain an isomorphic copy of the trellis on the right-hand 
side, which still represents C 1 . In the next result we will discuss the dualization leading 
to T 1 . Isomorphic versions of the trellises T° and T L appeared already in [8, Ex. IV. 12, 
Rem. V.4]. 

We now continue with a very simple and natural way of dualizing the trellises defined in 
Definition |2.8[a). This has been introduced by Nori/Shankar in [15J. 



Proposition 3.3 ( |15|, Def. 11]) Let T = Tiq HD \ be as in Definition 2.8(a) and suppose T 
represents the code C. Then the trellis T, HG jjt\ represents the dual code C L . We call 
T( H G DT) the BCJR-dual of the trellis T, denoted by T 1 . 

One should bear in mind that even if the trellis T is a BCJR-trellis in the sense of 
Definition |2.8[ b), that is, its displacement matrix is based on a span list, then T 1 is not 
necessarily a BCJR-trellis in that sense, but only a trellis of the type defined in part (a) of 



that definition. This can be seen from Example 3.2 2) above. The trellis T given therein is a 
BCJR-trellis, and one can easily check that the displayed trellis T 1 is indeed its BCJR-dual. 
Obviously the trellis T 1 is mergeable (merging the states (000) and (011) in Vq does not 
create any new cycles), and thus T 1 is not a BCJR-trellis due to Theorem |2.9[ a). 

For trellises of the form T = TrG,H,D) t we now have two ways of dualizing them, both 
of which result in trellises representing the dual code. By construction, the dual trellises T° 
and T 1 have the same SCP. In general, however, these trellises are not isomorphic, as we 
have seen already in Example |3.2[ 2) above. Next we will show that, just like in the above 
example, T 1 is a subtrellis of T°. 



Proposition 3.4 Let T = T(g,h,d) be as in Definition 2.8(a). Let Ej and (Ej)° be the 



transition spaces of the duals T 1 and T° , respectively. Then Ej £ (Ej)°, up to trellis isomor- 
phism. 

In the proof we will construct the local dual based on a suitable choice of dual state space 
and inner form, which will then make T 1 a true subtrellis of T° and not just an isomorphic 
copy. 

Proof: Let Vj = imiVj and Ej = im(iVj, Gj , Nj+i) be the state spaces and transition 
spaces of T, where the matrices Nj are defined as in ( 2.2 ) . By the very definition of the BCJR- 



dual, the state spaces of T 1 are given by Vj = imiVj, where Nj - Nj. Notice that the bilinear 

form Vj x Vj — > F, defined as (aNj, f3Nj) := aNj(3 T , is well-defined and non-degenerate. So 
we may construct the local dual T° based on this form. Obviously, dimVj = dimV^- for all 
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j € I, and the transition spaces of T° are 

, nw \. n ~ . - „ - a7V v /3 T + aGjft - aiV, + i/3 T = 

(^0° = |( 6, , vs- x f X for ^ o(JVi ; G x ^ ^. 

Now we see that ^ = im (JV 3 - 3 iV i+1 ) c (E:,,) since for all @(Nj, Hj,N j+1 ) e ^ and a e F fc 
we have aNjf3 T + aG]H j f3 T - aN j+1 (3 T = a(Nj + GjHj - N j+1 )/3 T = , due to (Q. □ 
Now we are ready to show the main result of this section. 

Theorem 3.5 IfT is a KV-trellis of C, then T 1 is isomorphic to T° . 

One should keep in mind that at this point it is not clear whether T 1 , hence T°, is a KV-trellis 
of the dual code. This is indeed the case, as we will prove in Section [4} 
Proof: By Theorem 



2.12 



we may represent T as a BCJR-trellis T = T^q HS ^, where 
GeF fexn has rank k and S = [(ai,bi],l = l,...,k] is a span list of G consisting of characteristic 
spans of C. Put A = {a± 
By Proposition 



3.3 



,a k } andi3 = {b l7 ...,b k }. Let N = D and Nj be as in (2.3), (2.2) 



and Ej 



the trellis T 1 represents C 1 and has state and transi tion spaces Vj ■- im Nj 
— im (Nj, Hj, Nj+i), where Nj = Nj. In light of Proposition 3.4 it suffices to show 
that dim(Ej)° = dim£j for all j e X. 

Denote the SCP and ECP of T by (so> • • • , Sn-i) an d (eo, • • • , e n -i), respectively, and let 
e° = dim(£ , j)°. Since T is isomorphic to the corresponding product trellis Tqs, the formulas 
in Proposition 2.3 'd) apply. Thus we have ej = Sj+x if j j. B and ej = Sj+\ + 1 if j 6 B. 



Using (3.2) this leads to 



e° = Sj + 1 if j B and e° = Sj if j e B. 
On the other hand, the recursion in ( |2.2[ ) implies that 

ej := dim(4) = rk (Nj,Hj,N j+1 ) = rk (Nj,Hj). 



(3.4) 



(3.5) 



Using that iVj = has rank Sj, we conclude that ej = Sj iff f/j e imiVj and = Sj + 1 
otherwise. But then Lemma 2.13 shows that e,- = Sj iff j e B and e,- = Sj + 1 iff j ^ i3. 
A comparison with (3.4) establishes dim(£ , j)° = dimE'j for all j £ I. So the trellises are 
isomorphic. □ 
The following example shows that T L = T° may be true even if T is not a KV-trellis. 

Example 3.6 Let C = imG = keri? T c F|, where 



/0 1 1 1 1 1\ 
1110 
T 1 1 lj 



(0 1 1 0\ 
,# = 1100110 

11110 1; 



Consider the span list S = [(1,5], (2,4], (3,1]] for G. One can easily verify that (1,5] and 
(2, 4] are characteristic spans of C, but (3, 1] is not (there exists a codeword with span (3, 0]). 
Hence the product trellis Tq$ is not a KV-trellis. By straightforwardly computing the data 
for Tq.s and the corresponding BCJR-trellis T := T( GHS -j, one obtains that both trellises 



have SCP (1,1,1,2,3,2). Hence they are isomorphic due to Theorem |2.9[ c). Their ECP is 
(1,2,2,3, 3, 2). The displacement matrix of T^ G H S ^ is given by 



/0 0\ 
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Let us now consider the BCJR-trellis T, HG g~> of C L , where S - [(2,4], (3,0], (0,5]] is the 
chosen span list for the rows of H. Its displacement matrix turns out to be Nj. As a 
consequence, T 1 = T^g^S) 1 = t (G,h,n ) L = T (h,g,n^) = T (h,g,S)- 0ne can also easil y verif y 
that T, HG g^ = T H g. Now it is easy to check that both T 1 and T° have ECP (2, 1,2,3,3,2). 
Thus Proposition O yields T 1 =T°. 



4 A Duality for Characteristic Matrices 

In this section we will restrict ourselves to KV-trellises. Recall from Theorem l3.5l that for these 
trellises the local dual and the BCJR-dual coincide, and hence we may use these dualizations 
interchangeably. In |1Q|, p. 2097], Koetter/Vardy formulated the conjecture that if (X,T) 
and (Y, T) are characteristic pairs of C and C 1 , respectively, then for every a KV(x,T) -trellis 
there is a KVy^ -trellis with the same state complexity profile. They actually restricted the 
characteristic matrices to a specific choice, the lexicographically first ones, and also made the 
correspondence more precise. In [HJ Ex. III. 13, Ex. V.2], however, it has been shown that the 
conjecture is not true in this generality, and in particular not for the lexicographically first 
characteristic matrices of C and C 1 . In this section we will prove the following reformulated, 
but much stronger, version of the Koetter/Vardy conjecture: for each characteristic pair 
(X, T) of C there exists a characteristic pair (Y,T) of C L such that the dual of a KV/x,T)~ 
trellis is a KV^yr^-x -trellis. Since, due to Theorem 3.1, the local dual and the primary trellis 
have the same SCP, this result covers indeed Koetter/Vardy's original conjecture. We will 
also explicitly construct the dual characteristic matrix Y. The details of our result also extend 
a theorem in [5J Thm. V.3], which showed how the characteristic span list of the dual of a 
minimal trellis of C looks (recall from Theorem |2.5[ b) that minimal trellises are KV-trellises). 

A first step toward formulating the duality conjecture had been done in |10| . Our general 
assumption that both codes C and C 1 have support I is crucial for this result and the rest of 
this section. 

Theorem 4.1 ([10, Thm. 5.12]) IfT= [(a;, b{\, I = 1, . . . , n] is the characteristic span list 
of C, then the characteristic span list of C 1 is given by [(pi, a{\, I = 1, . . . ,n\. 



As a consequence, one easily derives from Proposition |2.3[ d) and Definition |2.4[ iv) 
that if one selects k linearly independent characteristic generators of C with spans, say, 
[(ai, bi], I = 1, . . . , k] and n-k characteristic generators of C 1 that do not have spans (bi,a{\,l = 
1, . . . , k, then the resulting product trellises have the same SCP; this has been proven in \10\ 
Prop. 5.13]. However, it is not guaranteed that those n-k dual characteristic generators 
are linearly independent and thus generate C 1 . Indeed, this is not the case in general; see 
[HJ Ex. III. 13, Ex. V.2]. Furthermore, even if those dual generators are linearly independent, 
they may not give rise to a KV-trellis dual to the KV-trellis of C; see Example |4.10| below. 
Despite these obstacles, the result in [10, Prop. 5.13] indicates how the dual should look: if 
the dual of a KV-trellis of C is a KV-trellis of C L , then its span list has to be given by the 
reversed complementary spans in the above sense. This is indeed the only option for the dual 
characteristic span list because in [El Prop. III. 14] it has been shown that different selections 
of n-k characteristic spans lead to non-isomorphic trellises. All of this leads to the following 
useful notation. 

Definition 4.2 Let (X,T) and (Y, 7) be characteristic matrices of the codes C and C L , 
respectively. A pair (X, Y) is called a duaJ selection of (X, Y) if X 6 F fcxn is a submatrix 
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of X and Y e F^ n k ^ xn is a submatrix of Y such that their corresponding span lists S c T 
and S c T satisfy 5 = T\ [(5, a] | (a, 6] € «S]. 

In this section we will prove the following. 

Theorem 4.3 Let (X, T) be a characteristic pair ofC, and let / be the characteristic span 
list of C 1 . Then there exists a characteristic matrix Y of C 1 such that each dual selection 
(X,Y) of (X, Y) satishes the following properties. 

(1) rkX = k^rkY = n-k. 

(2) Let rkX = k and let S c T and S c T be the characteristic span lists of X and Y, 
respectively. Then the KV-trellises T^ s and T y g are dual to each other. 

Recall that in the situation (2) the trellises s and T y g represent C and C 1 , respectively. 
We will show this result by explicitly constructing the dual matrix Y. Here is an outline 
of the quite technical procedure. Fix a characteristic matrix X of C = ker H T and consider 
the BCJR-trellis Trx,H,T) based on the entire matrix X. For each m = 1, . . . ,n consider the 
subtrellis T m of T generated by all characteristic generators except the m-th one. Let the 
omitted generator have span (a m ,b m ]. Then one can find a cycle in the local dual (T m )° 
with span (6 m , a m ], and hence the associated edge-label sequence is a characteristic generator 
of C 1 . This is carried out in Proposition 



4.6 



(with the special case where b m - appearing in 
Lemma 4.5). Collecting all of these dual characteristic generators results in a characteristic 
matrix Y for C L . This is the matrix Y that will satisfy Theorem 4.3 Unfortunately, it 



is not a priori clear whether the pair (X,Y) satisfies the dual rank condition in part (1) 
of Theorem 4.3 Its somewhat technical proof is given in Proposition 4.9 For this step, 



the BCJR-representation of the trellises turns out to be crucial as it provides us with a 
close link between states and dual codewords. Once the dual rank condition is established, 
Theorem |4.3[ 2) is essentially a consequence of the construction. Indeed, pick a subset K. c X 
such that \K\ = k, and let X consist of the characteristic generators in X with span list 
S = [(a/, bi] | / e JC]. Then the KV-trellis T, XHS -. is a subtrellis of T m for each m £ /C, 
and therefore each characteristic generator in Y with spa n in [(b m , a m ] \ m K] appears 

As a consequence, Theorem 4.3(1) tells us that if rkX - k, 



in the local dual of T,j^ HS y 



Theorem 

The only detail 

that needs attention is the choice of the dual state spaces and the bilinear form. But this 
comes with the construction of Y, and it is easy to verify that it is indeed non-degenerate, 



then these n - k generators give rise to the entire local dual of T,j^ H s ^ . 



see Proposition 4.11 Finally, in Theorem 4.12 we will make the isomorphism, hidden in (2) 



of Theorem 4.3, explicit by using suitable BCJR-representations. 



Throughout this section we will use the following notation. 



Notation 4.4 Let C = kerH T c F n be a /c-dimensional code as in (1.2) and ( |1.3[ ). Recall 
that we assume that both C and C L have support I. Furthermore, let (X,T) be a fixed 
characteristic pair of C, and write X = (:%)y=o,...,n-ij where the rows of X are sorted such 
that T = [(oj, Z], I = 0, . . . ,n — 1]. Hence we index the characteristic generators by 0, . . . , n - 1. 
Since C 1 has support I, no characteristic span is empty and therefore I\(ai,l] = (l,ai] for 
all I e X. Let Xj, . . . ,X~^_i be the columns of X (we will always denote the j-th column 
of a matrix M by Mj). Let T = T(x,H,T) be the associated BCJR-trellis. The state space 
matrices of T will be denoted by Nj e Y nx ( n ~ h \ j e 1. Recall that the BCJR-construction is 
completely row-wise, that is, the Z-th rows of the matrices Nj solely depend on the generator 
with span (ctj,Z]. In the following, we will consider various submatrices of N and X. In all 
of these instances, we will index the rows of the submatrices by the ending point I of the span 



(ai,l] they correspond to. In this situation, Theorem 2.12 reads as 
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(1) row(A r j, /) = for all I such that j j. (ai, I], 

(2) the set {row(iVj, /) | I such that j e (ai, I]} is linearly independent for all j e X. 

We start with the following technical lemma. It results in a characteristic generator c e C L 
with characteristic span starting at time and which is normalized in such a way that cq = 1. 

Lemma 4.5 Let G e ]p( n ^ 1 ) xn De the matrix consisting of all except the first row of X and 
let S = [(a;, I], I = 1, . . . ,n - 1] be its span list. Consider the BCJR-trellis T(g,h,s) with state 
space matrices Qj e F^" 1 )^ 71 "^, j el. 
Then there exists a unique vector v e F n ~ fc such that Gq 



Qiv t . For jel put 



if j e (0,a ], 
otherwise 



and define the dual codeword c = (co, . . . , c n _i) := vH e C 1 . Then 

(j) the duai codeword c has span (0,ao] and cq = 1. 

(ii) Q^ 7 = for aJi j £ (0,a ]. 

(h'i) QjifJ + Gjcj - Qj+iwJ +1 = for all j e 1. 



Observe that due to Definition |2.4[ iv), there exist k conventional characteristic spans (that 
is, spans not containing 0). Since e (ao,0], this implies that G contains all k characteristic 
generators with conventional spans. In other words, G contains an MSGM of C. Therefore 
imG = C, and the trellis T^q H ^ does indeed represent C. 

Proof: By definition, G = {xu) i=i,..., n -i . First notice that statement (hi) follows from 

j=0,. 

the previous parts due to the identities Cj = vHj = HjV T and QjivJ = Qjv T along with the 
recursion 

Q j+ i = Q j + G]H j fajeZ, (4.1) 



see (2.2). Thus it remains to show the existence of v and properties (i) and (ii). Let us 
first collect some properties of the matrices Qj. By definition of BCJR-trellises, they are 



the submatrices of Nj obtained by omitting the first row, where Nj is as in Notation 4.4 



Due to property (iv) of Definition 2.4 each index j e X is contained in exactly n - k of the 
characteristic spans of C. With the aid of Notation |4.4[ 1) and (2), we may therefore conclude 
that 

n-k, if j e (0,o ], 
n-k-1, ifj^(0,o ]. 



rk Qj 



(4.2) 



Moreover, 



rk (Qj, Gj) = rk (Gj,Q j+1 ) = rk (Qj,G], Q j+1 ) 



'rkQj, ifj = oo, 

vkQj + 1, ifj'^oo, 

rkQj+i, if j = 0, 

{rkQj+i + 1, ifj^O. 



(4.3) 



The first two identities are a consequence of the recursion (4.1 ). As for the 4 cases of the last 
identity, recall that by Theorem 2.12, the trellis T/g,h,S) * s isomorphic to the product trellis 



Tqs. Therefore, we may apply Proposition 2.3 'd). Since the set of starting points is I\{ao} 



and the set of ending points is Z\{0}, we immediately obtain the 4 cases above. 

Now (4.3) and (4.2) imply the existence of a unique v e F n ~ fc such that = Q\v T . This 



results in Gj = (Qo + GqHq)v t , and thus Gq(1 - Hqv t ) = Qqv t . But the second case 



in (4.3) shows that Gj is not in the column space of Qo, and therefore we may conclude 
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that Co = Hqv t = 1 and Qov T = 0. If ao = n — 1, then all of this shows that the span of c is 
contained in (0, n- 1]. Since Theorem 



4.1 



gives that the latter is a characteristic span of C L , 
Lemma 2.6 implies that the span of c equals (0,n- 1]. This proves (i) and (ii) for ao = n— 1. 
Let us now assume oq < n - 1. From the very definition of BCJR-trellises we know that 



n-l 



row(Q ,0 



f = 1, 



1: 



for the row indexing see Notation 4.4 Recall that {ai, . . . , a n -i} = {0, . . . ,n - l}\{ao}. Hence 
there exists some I for which ai -n-l. Since xi a , f 0, the identity tow(Qq,1)v t = 
yields H n -iv T = 0. Now we can proceed recursively to obtain Cj = Hjv T = for all j - 
n- l,n- 2, . . , , ao + 1. Hence the span of c is contained in (0,ao], and again Lemma 2.6 yields 
equality. This establishes (i). 

As for (ii) we also proceed backwards. From Qov T - and H n ^iv T = we obtain Q n -\v T = 
(Qo - G , ^_ 1 -ff n _i)t> T = and successively Qjv T = for j = n - l,n - 2, . . . , ao + 1, as desired. 
This completes the proof. □ 
Using the behavior of the characteristic matrix and BCJR-trellises under the cyclic shift 



as summarized in Remark 2.11 the lemma above generalizes to any characteristic span. This 
leads to the following result. 

Proposition 4.6 Fix m e 1 and denote by X m e F^ 1 )*" and NJ 1 e F^- 1 )^™-^ the sub- 
matrices of X and Nj, respectively, where the m-th row has been omitted. Denote the 
columns of X m by {X m )1, . . . , (X" 1 )^^. Then there exists a unique vector v„ 
the following properties: 

(a) (X m ) T m = N™ +1 vl, 

(b) the dual codeword c r ' 



e ¥ n ~ k with 



l c ' • 



i c n-l) - 



X H € C 1 has span (m, a m ] and satisfies c™ = 1 



(c) N™vl = Qforj{(m,a m ], 



(d) N 



J m,j 



+ (X m )]cf 



1 ^j+l w m,j+l 



for all j € X, where w m j e F n k is defined as 



w 



v m , ifj€(m,a m ], 
0, otherwise . 



As a consequence, the pair (Y,T), where 

t= [(m,a m ],m = 0, ...,n-l], 



/ c° \ 



Y 



is a characteristic pair of C 1 . 



ye- 1 / 



(4.4) 



this is exactly the statement of Lemma 



4.5 



Part (a) translates into 



Proof: For m 

Qiv T in that lemma and (b), (c), (d) are (i), (ii), (iii) of that lemma, respectively. For m > 
we may apply the left cyclic shift cr m by m units on the characteristic generators. As detailed 

imG* = 



N j+m for 



in Remark 2.11, this results in a characteristic pair (X*,T*) for the code cr m (C) 
ker H* T with BCJR-trellis T^x*,H*,T*)- ^s state space matrices are given by N* - 
j e X. This shifts the span (a m , m] to the span (a m -m, 0] and we may use Lemma 4.5 again. 
Applying now the inverse shift a n ~ m lead s to the statements in (a) - (d). The consequence 
about (Y, 7j is clear due to Theorem 



4.1 



One should observe that the identities in Proposition |4.6| (cl) indicate that the dual code- 
word c m and the states w m j, j e X, give rise to a cycle in the local dual of the trellis 
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T(x m ,H,T m )i where T m is the characteristic span list of X m ; see also (3.1 ). We will make this 



precise later on after specifying the dual state spaces and the bilinear form as needed for the 
local dualization. 



Example 4.7 Consider the self-dual code from Example 2.10[ b) with characteristic ma- 
trix X given in (2.5) and characteristic span list T = [(3, 0], (2, 1], (1, 2], (0, 3]] ordered as 
required in Notation 4.4 The matrix, displaying all information about the trellis Trx,G,T)> 
is given by 



S = {N Q \xS\Nx\X[\N 2 \xZ\Ni\xZ\N Q ) 



Omitting the m-th row from S, where m - 0, ... ,3, we see that 
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0/ 



/0\ 



W 



■-m 



/0\ 

1 

w 



■-No 



■■N4 



(1\ 



w 



Hence vq = (11), v\ = (01), v 2 = (10), and V3 = (11). Recalling that H - G due to self- 
duality, we obtain c° = v G = (1001), c 1 = viG = (0110), c 2 = v 2 G = (1111), and c 3 = v 3 G = 
(1001). Thus, the characteristic pair (Y,7~) for C 1 = C, resulting from this procedure, is given 
by 



Y 



/c u \ 

1 



\c 3 / 



n 

1 




1 

1} 



T= [(0,3], (1,2], (2,1], (3,0]]. 



One should notice that even though the code C is self-dual, the matrix Y is not identical to 
the characteristic matrix X of C in (2.5), with which we started the procedure! 



As mentioned earlier, the identity in Proposition |4.6[ d) gives rise to cycles in certain local 
duals, namely (w m ,o, c™, w m>1 , cf, w mt2 , c^ 1 , w m ,3, c™, w mfi ). The matrix 
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l) 



contains these four cycles. Proposition |4,6[ d) now states that for m - 0, ... ,3, the m-th row 
of S is in the local dual of the trellis determined by the three rows of S not having index m. 



Using the definition of the local dual in (3.1) this can also be verified directly. 



Now we can formulate the main result of this section. 



Theorem 4.8 Let (X,T) be as in Notation 4.4 and Y as in Proposition 4.6 Then the pair 
(X,Y) satisfies Theorem\4.3\ 



The proof consists of several steps. We begin with Part (1) of Theorem 4.3 It is worth 
pointing out that for the proof of this result the BCJR-description of the trellises involved is 
crucial. It directly links the "dual states" v m to the associated dual codewords c m , making 



the second equivalence in (4.5) below obvious 
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Proposition 4.9 Let v m and (Y, T) be as in Proposition 4.6, and let AC u AC - X be an index 
partition such that |/C| = k. Let X e Y kxn be the submatrix of X consisting of the generators 
with spans in the list S ■- [(o;, Z] \ I e 1C], while Y e ]p(«- fc ) xn j s ^ ne submatrix ofY consisting 
of the dual generators with spans in S ■- [(m,a m ] | m € AC]. Then (X,Y) is a dual selection 



of (X, Y) in the sense of Definition 4.2 and 

rkX = k <^=> {v m | m e AC} is linearly independent 



rk Y = n- k. 



(4.5) 



Proof: By Proposition 



4.6 



b) we have Y = [y m H^ Using that rkH = n - k, this imme- 
diately establishes the second equivalence in ( |4.5[ ). 

As for t he first equivalence, we need some preparation. Recall the matrixes Nj from Nota- 
and define Nj e ]F fcx ( n_fc ) as the submatrices of Nj consisting of t he r ows with indices 

Since AC and AC 



tion 4.4 

in AC. Consider also the matrices X m and NJ 1 



as defined in Proposition 

are disjoint, we observe that for each m e 1C the matrices X and Nj 
of X 

of X by X { 



4.6 



and NJ 1 , 

LQ , . . . 



are the submatrices 

respectively, consisting of the rows with indices in AC. Denote the columns 

yields 



Then Proposition 



4.6 



X = N m+ \v for all m € AC. 



(4.6) 



Now we can prove the equivalence. 

"<^=" First suppose that rkA < k, and let aX = for some a e F fe \{0}. We will index 
the vector a by Z e /C to be consistent with our indexing of the rows of X. With the aid of 
the recursion Nj+i 
Thus, uNq = aNi = 
Notation 



Nj + XjHj, we compute aNj+i 



aiNj + XjHj) 



4.4 '2 



...... /7 n A'y for all j i X. 

= aiV n _i =: w. Suppose w - 0, and hence a e R^Jo ker iVj . But then 
tells us that the identity aNj = leads to ol\ 



lj=0 ^-"j- 
for each Z e AC such that 



j € (o;,Z]. Since no span (a/,Z] is empty, this results in a = 0, contradicting our assumption. 



Hence w ^ 0. Next, along with (4.6), the identity aX = implies aiVro+iU" = and hence 



wv r 



for all m € K. This shows that the matrix (v^, m e AC) e ]p(«- fc ) x (™- fc ) j s singular, 
and therefore the set {v m \ m e AC} is linearly dependent. 

"^=>" Assume rkA = k. Then C - iraX - kerif T , and the matrices Nj are the state space 
matrices of the BCJR-trellis T,v u c\- Let m e AC) = for some w e ¥ n - k . We first 



show that w e imiVJ 



for all m e AC and all j e X. In order to do so, notice that the rank 



condition in (|4.2 



generalizes to iV™ as rk iV™ - = n — A; if j e (m, a m ] and rk A^™ - n - k - 1 if 



j ^ (m, o m ]. Thus, if j e (m, a m ], then im iVj 



F' r ' 



then rkiVJ 
u; e imA r j n , 



1 = n - k - 1 and Proposition 
as desired. 



4.6 



If j ^ (m,a m ], 

c) yields imiVf = (im^) 1 in F n ~ fc . Thus, 



and hence u> e imAf™ 



Now we have u> = at^NY 1 for all m € AC and some oUf € F 



n-l 



Then Notation 



4.41) tells us 



that for every m e AC we have u; e span{ row(iVj, Z) | Z such that j e (a/,Z], Z j- m). From this 

rov 

Z ^ AC and j e (a/, Z]}. 



and the linear independence of the nonzero rows in Nj, see Notation 4.4 '2), we conclude that 
w e span{ row(Aj , Z) | Z ^ AC and j e (a/,Z]}. But the latter space is imJVj, and, since j € X 

(XHS) 1D a iv V-trellis, we may 
e AC} is linearly 
□ 



was arbitrary, this proves that w e Dj=o w-^j 



n_1 iniJVi. Using that r^ U(; , is a KV-trellis, 



apply Theorem 



2.14 



and conclude that w = 0. As a consequence, {tv 



independent. This concludes the proof of the remaining equivalence in (4.5). 



So far we have proven the dual rank property in Theorem |4.3[ 1). It is worth noting that 
this does not guarantee that part (2) of that theorem is also satisfied. This is due to the fact 
that KV-trellises based on the same span selection but on different generators need not be 
isomorphic. Indeed, we have the following example. 
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Example 4.10 Consider again the code C £ F| from Example 2.10 'c) with the characteristic 
matrix X as given there. The dual code has characteristic span list T - [(1,0], (0,1], (3, 2], 
(2,3]] and the matrices 



are both characteristic matrices of C 1 . Both are normalized, that is, the generators have 
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coordinate 1 at the starting point of their span. Proposition 4.6 applied to the characteristic 
matrix X of C, produces the matrix Y\. It is easy to see that both pairs (X, Y{), i = 1,2, 
satisfy the dual rank condition (1) of Theorem 4.3 for all dual selections. It is a bit more 
tedious to show that only Y\ satisfies part (2) of Theorem 4.3 for all full rank dual selections. 
Indeed, the two KV-trellises resulting from the first two rows of Y\ and Yz are not isomorphic^ 
and only the trellis resulting from Y\ is the dual of the KV-trellis of C corresponding to the 
last two rows of X. 



Thu s, it remains to prove (2) of Theorem 4.3 in order to complete the proof of Theo- 
rem 4.8 Precisely, if rkX = k in Proposition 4.9, then the pairs (X,S) and (Y,S) give rise 
to KV-trellises of C and C 1 , respectively, and we aim to show that these trellises are duals of 
each other. Since for KV-trellises, the BCJR-dual and the local dual are isomorphic, we may 
use either approach. The initial idea in Proposition 4.6 was motivated by local dualization, 
and therefore we will use that construction. While we do have a description of the state 
spaces Vj of T,£ h s)> we ^° no * ^ nave dual state spaces Vj and a non-degenerate bilinear 
form on Vj x Vj which are needed to establish a local duality as in Theorem 3.1 Example 4.7 
shows that the standard bilinear form on ¥ n ~ k restricted to Vj is in general degenerate, and 
therefore Vj = Vj along with this bilinear form is not an option for the local dualization: 
take, for instance, fC = {0, 1}; then V\ = im(l, 1). On the other hand, the example and the 
construction preceding it indicate what the dual state spaces should be: the spaces generated 
by the "dual states" v m . All this leads to the following result. 



4.9 



Proposition 4.11 Let /C, /C, (X, S), and (Y, S) be as in Proposition 

and let Vj ■- im Nj, where Nj e j?kx(n-k) arg ^ e state space matrices of the KV-trellis 



Assume rk X = k, 



T:=T,v 



(X,H,S) 



. For 7 e X define the matrices Pj e F^ n fc ) x (™ ^ via 



Tow(Pj,m) = w. 



o, 



if j e (m,a m ] 



' " otherwise 



for m e tC. 



(4.7) 



Put Vj ■= im Pj and Ej = im {Pj,Y- , Pj+i) for j e I, where Y- denotes the j-th column ofY. 
Then 

(1 ) rk Nj = rk Pj = rk NjPj for all j e I. As a consequence, dim Vj = dim Vj for all j e I and 
the bilinear form 



Vj - Vj 



F, (ctNj , pPj ) i— ► otNjPj' $ 



(4. 



is non-degenerate. 



(2) The trellis f = (V, E), where V = U"=o v j and E = U"=o Ej> is a linear trellis represent- 



ing C 1 and T - T° , where we dualize with respect to the bilinear form (4.8). Moreover, 
the trellis T is isomorphic to the KV^ Y -f)~t rems Tf §■ 



2 In the first trellis, the unique cycle representing the codeword (1112) 6 C 1 passes through the zero state 
at time 1, but this is not the case in the second trellis. 
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Proof: (1) Recall that by property (iv) of Definition 2.4 e very index j is contained in 
exactly n—k characteristic spans. Thus, with the aid of Notation 4.4 1) and (2), and \fC\ = n-k 
we compute 



\{l e K, | j e {a u l}}\ =n-k- \{m e K, \ j e (a m ,m]}\ 
\{m e /C | j { (a m ,m]}\ = \{m e £ | j e (m,a m ]}\. 



But the last quantity is exactly rkP,- due to Proposition 4.9 



It remains to show rkNj = 



ikNjPj. We will do this by showing keiNjPj = kevNj. Clearly, we have "2". For the 
converse, let aNjPj = for some a e ¥ k . Then aNjV^ = for all m e K such that j e 
(m, a m ]. Al ong with Proposition 4.6 ^c) this leads to aNjV^ = for all m e K,. But due to 



Proposition |4.9| the matrix (v m \ m e K) e ]p( n " fe ) x ("- fc ) i s non-singular and thus we conclude 
aNj = 0. This concludes the proof of the rank identities. The non-degeneracy of the bilinear 
form follows from kerNjPj = ker Nj and ker PjNj T = ker Pj. 

(2) We first show T = T°. In order to do so, we have to prove Ej = (Ej)° , where Ej 



im (Nj,Xj , Nj+i) are the transition spaces of T, and (Ej)° are the duals in the sense of (3.1 ) 



i) for m e JC. Since (Nj,X, , Nj+i) is a 



The rows of (Pj , Yj , Pj+\) are given by (w m ,j , cf, w m j+ 
submatrix of {NJ 1 , (X rn )J , N™ +1 ) for all m e K, Proposition k6[d) shows that Ej ^(Ej) . For 

rk Ni = rk Pa 



the converse we will show that th e tw o spaces have the same dimension. Let s 3 
Then Theorem 



and ej = dim Ej 



3.1 



tells us that e° := dim(Ej)° = Sj + Sj+\ + 1- ej. Moreover, 
being a KV-trellis, T is isomorphic to the product trellis s . Therefore, Proposition 2.3 [d) 

tells us that ej = Sj+\ if j e K. and e 3 - = Sj+i + 1 if j e K.. Thus 

e° =Sj + li£j€K and e° = Sj if j e K.. 
Using that diml?j = rk (Pj,Y? ,Pj+i) > rkPj = Sj for all j, we obtain dim Ej > e° for j e X. 



If j ^ /C then j g ^ and row(Pj, j) = due to (4.7). Since the j-th entry of Y^ 7 is given by 
c j j = 1, this yields dimi^ = rk (P,-, Y^ 7 , > rkP,- + 1 - Sj + 1 = e°. Along with Ej £(Ej)°, 
all of this shows Ej = (Ej)°, and therefore T = T° . Consequently, T represents C 1 . 
It remains to show that T is isomorphic to the KV^ Y f^ -trellis Ty g. For this remember 

that the latter has state spaces imMj and transition spaces im(Mj, Yj, Mj + i), where Mj 
is the state space matrix as in Definition 2.2 based on the span list [(m,a m ] | m e }C]. As 



a consequence, the rows of Mj with index m such that j e (m, a m ] are linearly independent 



while all other rows are zero. Comparing this with (4.7) and making use of Proposition 4.9 



we see that aMj i-> aPj induces a well-defined isomorphism between im Mj and Vj = im Pj. 
Now the very definitions of the transition spaces of T and T y g show that this gives rise to a 
trellis isomorphism. This concludes the proof. □ 
This establishes the proof of Theorem |4,8[ 

Having the dual pairing (X, Y) of characteristic matrices allows us to express the duality 
of their KV-trellises in terms of BCJR-representatio ns. I ndeed, let (X, Y) be a dual selection 



4.9 



and such that rkX = k, thus vkY 



of (X, Y) with span lists S and S as in Proposition 
n-k. Then Y and X are parity check matrices of C and C L , respectively, and may be 
used for the BCJR-representations of the codes. This results in the KV-trellises T,j£ Y s) 

By definition of the dual matrix Y, we have Y = UH, where 
is non-singular due to Proposition 4.9 Thus, the trellis T,^ f s) 
is isomorphic to the trellis T,g HS y, see also [H Rem. IV. 4]. As a consequence, the trellis T 
of Proposition 4.11 2), being the local dual of T^ HS y is isomorphic to the local dual of 



of C and T, y x s) °^ ^ 



U - (v m ) 
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3.5 



A 



T(xys)> w ^ich in turn is isomorphic to the BCJR-dual T^^^y due to Theorem 
tedious, but straightforward matrix computation shows that this trellis satisfies the following 
symmetry. 



Theorem 4.12 Let the data be as in Proposition 4.9 and let rk A = k. Then 



T 1 - - - T - - - 
(X,Y,S) ~ 1 (Y,X,S)- 



The situation described in Example 4.10| may be used to show that this symmetry is not true 
for full rank dual selections of arbitrary pairs (A, Y) of characteristic matrices, even if they 
satisfy the dual rank condition. 

Let us close the paper with the following remarks pertaining to specific classes of codes. 
First, if C <= W n is a cyclic code, then it is easy to see that C has only one characteristic matrix 
(up to scalar factors). It is given by the n cyclic shifts of the generator polynomial, see also 
[9l Lem. 2]. As a consequence, this matrix and the corresponding characteristic matrix for 



the dual code satisfy Theorem 4.3 The dual rank condition of this theorem has already been 
proven in [9l Thm. 6]. 

Second, let us return to self-dual codes. Notice that for the self-dual code in Exam- 
ple |2jl(Jb), the pair (A, A), where A is as in ( |2.5[ ), does not satisfy the dual rank condition 
of Theorem |4.3[ 1). It is easy to check that A is not the lexicographically first characteristic 
matrix of that code (the lexicographically first characteristic matrix is obtained by choosing 
for each span the lexicographically first codeword having that span, and where the lexico- 
graphic ordering starts at the starting point of that span). In the proof of [9, Thm. 1] it 
was stated that for any self-dual code, the pair (A, A), where A is the lexicographically 
first characteristic matrix, satisfies the dual rank condition of Theorem |4.3[ 1). While this is 
indeed the case for the particular code in Example 2.10[ b), this is, unfortunately, not true in 
general. 

Example 4.13 Consider the extended [8, 4, 4]-Hamming code C £ generated by 

(1 1 1 1 0\ 
11110 
10 10 11 

Vo o o i i i i o/ 

Then 



G = 



X = 



fl 














1 


1 


1\ 


1 


1 








1 





1 





1 


1 


1 














1 


1 





1 


1 








1 








1 


1 


1 


1 











1 





1 





1 


1 

















1 


1 


1 


1 





lo 





1 





1 





1 


V 



T= [(5,0], (4,1], (7,2], (6, 3], (1,4], (0,5], (3, 6], (2, 7]] 



form a characteristic pair, and A is the lexicographically first characteristic matrix of C. It is 
easy to see that the pair (A, A) does not satisfy the dual rank condition in Theorem |4.3[ 1): 
the rows with spans (4,1], (7,2], (6,3], (3,6] are linearly independent, whereas this is not 
the case for the rows with spans (5,0], (4,1], (7,2], (0,5] (these are the spans that are not 
the reversed spans of the first list). 



25 



References 



A. Al-Bashabsheh and Y. Mao. Valiant transform of Forney graphs. Preprint 2010. arXiv: 
1004.3833v2. 

L. R. Bahl, J. Cocke, F. Jelinek, and J. Raviv. Optimal decoding of linear codes for minimizing 
symbol error rate. IEEE Trans. Inform. Theory, IT-20:284-287, 1974. 

A. R. Calderbank, G. D. Forney, Jr., and A. Vardy. Minimal tail-biting trellises: The Golay code 
and more. IEEE Trans. Inform. Theory, IT-45:1435-1455, 1999. 

G. D. Forney, Jr. Codes on graphs: Normal realizations. IEEE Trans. Inform. Theory, IT- 
47:520-548, 2001. 

G. D. Forney, Jr. Minimal realizations of linear systems: The "shortest basis" approach. Preprint 
2009. To appear in IEEE Trans. Inform. Theory. arXiv: 0910.4336v3. 

G. D. Forney, Jr. Codes on graphs: Duality and Mac Williams identites. Preprint 2010. To appear 
in IEEE Trans. Inform. Theory. arXiv: 0911.5508v4. 

G. D. Forney, Jr. and M. D. Trott. The dynamics of group codes: State spaces, trellis diagrams, 
and canonical encoders. IEEE Trans. Inform. Theory, IT-39T491-1513, 1993. 

H. Gluesing-Luerssen and E. Weaver. Linear tail-biting trellises: Characteristic generators and 
the BCJR-construction. Preprint 2010. To appear in IEEE Trans. Inform. Theory. arXiv: 
1003.4539vl. 

H. Kan and H. Shen. A relation between the characteristic generators of a linear code and its 
dual. IEEE Trans. Inform. Theory, IT-51T199-1202, 2005. 

R. Koetter and A. Vardy. The structure of tail-biting trellises: Minimality and basic principles. 
IEEE Trans. Inform. Theory, IT-49:2081-2105, 2003. 

F. R. Kschischang and V. Sorokine. On the trellis structure of block codes. IEEE Trans. Inform. 
Theory, IT-41: 1924-1937, 1995. 

S. Lin and R. Y. Shao. General structure and construction of tail-biting trellises for linear block 
codes. In Proceedings of the 2000 IEEE International Symposium on Information Theory, page 
117, 2000. 

Y. Mao and F. R. Kschischang. On factor graphs and the Fourier transform. IEEE Trans. 
Inform. Theory, IT-5L1635-1649, 2005. 

R. J. McEliece. On the BCJR Trellis for linear block codes. IEEE Trans. Inform. Theory, 
IT-42: 1072-1092, 1996. 

A. V. Nori and P. Shankar. Unifying views of tail-biting trellis constructions for linear block 
codes. IEEE Trans. Inform. Theory, IT-52:4431-4443, 2006. 

Y. Shany and Y. Be'ery. Linear tail-biting trellises, the square root bound, and applications for 
Reed-Muller codes. IEEE Trans. Inform. Theory, IT-46: 1514-1523, 2000. 

Q. Yang and Z. Qin. An algorithm for computing characteristic matrices of group codes over finite 
abelian groups. In The J^th International Conference on Wireless Communications, Networking 
and Mobile Computing (WiCOM 2008), Dalian 2008, 2008. 

J. Zhou and T. Ohtsuki. Isomorphic constructions of tail-biting trellises for linear block codes. In 
Proceedings of the 2nd International Conference on Communications and Networking in China 
(ChmaCom'07), Shanghai 2007, pages 585 - 589, 2008. 



26 



